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ABSTRACT 


Poisson-driven  bilinear  systems  (or  linear  systems  with  multiplicative 
Poisson  impulse  noise)  are  considered.  The  Poisson-driven  canonical  exten- 
sion is  derived  by  means  of  the  product  integral;  its  properties  and  relation- 
ship to  modeling  questions  are  also  discussed.  Equations  for  the  moments 
of  the  state  are  derived,  and  the  resulting  criteria  for  stochastic  stability 
are  presented. 
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I.  INTRODUCTION 


Linear  systems  with  Gaussian  white  multiplicative  noise  arise  fre- 
quently as  reasonable  models  in  applications,  and  they  have  consequently 
been  studied  extensively  in  the  literature  [l-lO,  16-19],  In  some  applica- 
tions, however,  systems  are  subject  to  impulsive  disturbances  which  arrive 
randomly  in  time;  these  disturbances  can  be  modeled  as  Poisson  impulse 
(white)  noise  [ll].  Fortunately,  Poisson-driven  Markov  processes  have  been 
studied  in  depth,  and  a theory  analogous  to  that  for  vector  Ito  stochastic 
differential  equations  driven  by  Brownian  motion  has  been  obtained  [12-14], 
However,  there  are  some  important  differences  between  the  two  theories,  and 
some  of  these  have  important  implications  for  the  work  presented  here. 

In  this  paper,  linear  systems  with  multiplicative  Poisson  impulse  noise 

(also  called  Poisson-driven  bilinear  systems)  are  considered.  Using  the 
notation  of  Snyder  [13],  a Poisson-driven  bilinear  system  satisfies  the  inte'ral 
equation 

x(t)  = x(t^)  + f A(a)x(a)da  + IL  b(a,x(a),U)  • M(da,dU)  (1) 
''^o  o 


or  the  differential  equation 

dx(t)  = A(t)x(t)dt+  b(t,x(t)  ,U)M(dt,dUj 


(2) 


where  x(t)  is  a random  n-vector  or  an  n x n matrix,  A(t)  is  a non-random  n x n 
matrix,  b is  an  n-vector  or  n x n matrix  which  is  linear  in  x for  fixed  U,  M is  a 
time-space  Poisson  process  with  intensity  X(t)  [13,  p,  145],  and  '?/ is  the 
mark  space  of  the  compound  Poisson  process  associated  with  M,  The  last 
integral  in  (1)  is  the  counting  integral  which  has  an  evaluation  given  by 

N(t)  = 0 


0 

n=l 

N(t)  = /*  f M(da,dU)  is  the  number  of  incident  points  during  [t 

J t Jw  ° 


where 


1 


regardless  of  their  mark  and  t and  U are  the  time  of  occurrence  and  mark 
th  ^ ^ 

of  the  n point  (notice  that  N(t)  is  assumed  to  be  almost  surely  left-continuous). 
Thus  X will  have  discontinuities  at  the  times  and  the  size  of  the  discontinuity 
at  is  '^n^  further  details,  see  [13,  Section  4.2]).  A crucial 

result  for  such  systems  is  the  following  analog  of  Ito's  differential  rule  (a 
special  case  of  [13,  p.  199]). 


Lemma  1 (Differential  Rule):  Let  x(t)  be  a random  n-vector  valued 
process  satisfying  (1).  Assume  that  the  conditions  [13,  Section  4.2]  for  the 
existence  of  the  counting  integral  hold,  and  let  cp(t,x)  be  bounded  for  t and  x 
finite  and  have  continuous  first  derivatives  with  respect  to  t and  the  components 
of  X.  Then,  with  probability  one,  the  random  process  cp(t,x(t))  satisfies 


<p(t,x(t))  = cp(t 


do 


a,x(o)  + b(o,x(a)  ,U))  - cp(CT,x(o))]M(da,dU) 


(4) 


where  denotes  the  gradient  of  cp(o,x)  with  respect  to  x,  and  <• , • > 

denotes  the  usual  inner  product  of  n-vectors , 

In  the  remainder  of  the  paper,  this  and  other  results  will  be  used  to 
study  Poisson-driven  bilinear  systems.  For  simplicity  of  notation  we  will 
concentrate  on  the  case  in  which  the  mark  space  ^y=  [U^  , . . . is  finite 
so  that 

r ^ 

y^^b(t,x(t),U)M(dt,dU) ---  ^ b(t,x(t),U^)dN^(t) 

where  N^(t)  are  independent  Poisson  processes  which  count  the  jumps  of  the 
Uj.  However,  similar  results  can  be  obtained  for  more  general  mark  spaces. 
First,  systems  evolving  on  Lie  groups  and  homogeneous  spaces  will  be 
discussed  with  respect  to  some  general  modeling  questions,  and  the  Poisson- 
driven  canonical  extension  will  be  studied.  Then  equations  for  the  moments 
of  the  state  of  the  system  will  be  derived,  and  these  will  provide  criteria 
for  stochastic  stability. 
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II.  THE  POISSON -DRIVEN  CANONICAL  EXTENSION 


Consider  a rotating  rigid  body  whoso  orientation  is  described  by  the 
3x3  direction  cosine  matrix  X satisfying 


X(t)  = 


Z [V‘l  - 


X(t) 


(5) 


where  L are  the  components  of  the  nominal  angular  velocity,  A.  form  a basis 

for  the  Lie  algebra  so  (3)  of  3 x 3 skew-symmetric  matrices  (A^  f A|  = 0) , and 

u.  are  continuous  scalar  controls  [3,10].  Because  A = -A,,  it  is  obvious  that 
1 i 1 

— (X'(t)X(t))  = 0 and  X'(t)X(t)  is  constant  for  all  t.  Hence  if  X'(0)X(0)  = I and 
dt 

det  X(0)  = 1 , then  X(t)  evolves  on  the  Lie  group  SO(3)  = |x  € IR^  ^ ^ |X'X  = I,  det  X = + 1 
for  all  t. 

If  the  body  is  subject  to  torques  due,  for  example,  to  random  micro- 
meteorite collisions,  the  u^  may  be  approximately  modeled  as  Poisson  impulse 
disturbances  [ll].  In  this  case,  the  calculus  of  Poisson-driven  Markov 
processes  must  be  incorporated;  i.e.  ,'lt  is  assumed  that  X satisfies  an  equation 
of  the  form  (2)  where  the  mark  space  has  three  points  Uj^,U2,U2  corresponding 

to  the  inputs  u ,u,  ,u  . If  it  is  assumed  that  b(t,X,U.)  = B.X,  where  B.  is  a 
1 Z 3 1 

3x3  matrix,  then  x satisfies 

3 

dX(t)  = A(t)  dt  f 51  B.dN  (t)  X(t)  (6) 

i=l  ^ ^ 

where  N (t)  are  independent  Poisson  processes  which  count  the  jumps  of  U. 
and  have  intensities  X,(t).  If  (6)  is  to  be  the  Poisson  driven  form  of  model  (5), 
it  is  reasonable  to  require  that  the  solution  X(t)  of  (6)  also  evolve  on  the  Lie 
group  SO(3)--i.e.  , that  X'(t)X{t)  be  constant  for  all  t.  Conditions  under  which 
this  is  true  can  be  deduced  from  the  following  theorem,  the  proof  of  which  Is 
an  application  of  the  differentiation  rule  (Lemma  1). 


Theorem  1:  Assume  that  X(t)  satisfies  (6).  Then  X(t)  evolves  on  the 
Lie  group  |X:X'QX  = constant}  with  probability  one  if  and  only  if 

A'(t)Q  f QA(t)  = 0 for  all  t (7) 

and 

B;Q  + QBj  4 B'QB.  = 0;  i=  1,2,3.  (8) 

Proof:  The  differentiation  rule  (Lemma  1)  implies  that 

3 

d(X'QX)  --  X'(A'Q  f QA)Xdt  + (X+  B.X)'Q(X4-B  X)  -X'QxldN 

i=l  L 1 1 J i 

3 

= X'  (A’Q  + QA)Xdt  X'  (B;Q  + QB.  B'QB  )XdN  . 

iTi  ^ 1 i 1 i 

Hence,  d(X’QX)  = 0 (and  X'QX  remains  constant)  if  and  only  if  (7)  and  (8)  hold. 

Applying  this  result  to  the  rigid-body  orientation  example  in  v/hich 

Q = I,  it  is  necessary  that  A(t)  = A’(t)  and  B,  + B'  f B'B  = 0.  Notice  that 

i i i i 

the  skew-symmetric  A.  matrices  of  (5)  do  satisfy  the  latter  condition. 

Thus  the  Poisson-d.iven  form  (6)  which  corresponds  to  (5)  is  not  obtained 
from  (5)  by  merely  substituting  dN,(t)  for  u^(t)dt,  so  some  other  approach 
must  consequently  be  used.  This  phenomenon  is  analogous  to  the  widely 
discussed  case  in  which  the  u^  are  replaced  with  Gaussian  white  noise 
[7-9,  16-19]. 

One  method  for  defining  the  solution  of  the  deterministic  equation  (5) 
is  via  the  product  integral,  which  "injects"  the  functions  (f^(t)  f u^(t))  into 
the  Lie  group  SO(3)  (see  [15,16]).  Consider  the  deterministic  differential 
equation  on  [O  ,T] 

^(t)  =[2  yt)A,']x(t)  ; X(0)  = I (9) 


or 


i 


I 


1 
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dX(t)=p  (d^/t))Ajx(t)  ; X(0)  = I 


(10) 


where 


Here  X and  {a^3  are  n x n matrices,  t are  continuous  scalar  functions,  and 

^denotes  ^ . Notice  that  in  this  case  the  a.  are  Lipschitzian  [17].  Let 
i i=l 

'/’he  the  Lie  algebra  generated  by  [Aj^ A^ } and  G = {exp  the  corre- 

sponding connected  matrix  Lie  group  [4,7,8,10,20].  We  define  the  mapping 
from  k- vector  valued  functions  on  [0,T]  to  G-valued  functions  on  [0,T]  by 


(H^(a))(t)  = I , (t=0) 


(a.{t)  - a^(X2  "))A,  (H^(a))  ( A2“") , 


(tsO,  Z = [2"t]) 

(11) 


where  [m]  denotes  the  largest  integer  s m.  It  is  shown  in  [15,16]  that 

lim  H exists  uniformly  on  [0,T]  and  is  equal  to  the  transition  matrix 
n 

n-*“ 

i f - which  solves  (9);  i.e.,  the  solution  of  (9)  *s 


Kr  a (^'0)  = (H  (a))(t) 

^ n-*  ® 

jt-1 

= 1 i m exp[B(t,  / 2 *^)]  II  exp[B((j4-l)2  ,J2  )]  (12) 

n-* » J=0 


where 


ys)ds  . 


(13) 


McKean's  approach  [9]  (subsequently  extended  by  Lo  [7,8])  to  the 
Gaussian  white  noise  problem  involves  the  generalization  of  the  product 
integral  to  the  case  in  which 

5 


da^(t)  = ^(t)clt  + dw^(t)  (14) 

where  w is  a Brownian  motion  process  with 

^min(t,s) 

E[w(t)w'(s)]  = R(T)dT  . 

It  is  shown  in  [7-9]  that  lim  H converges  uniformly  on  [0,T]  almost  surely 

n 

n-»oo 

to  the  solution  of  the  Ito  equation 

dX(t)  = ||2  2 S ^ij  ^ S A.dw.  (t)  X(t)  (15) 

X(0)  = I 

and  that  X evolves  on  G almost  surely.  Hence  (15)  can  be  considered  the 
"Ito  form"  of  (10)  when  a^  is  given  by  (14)  (there  will  be  further  justification 
for  this  point  of  view  in  the  sequel) . 

We  now  consider  a similar  approach  to  the  Poisson  white  noise 
problem.  Thus  we  define,  for  i = 1 , . . . ,k, 

da^(t)  = f^(t)dt  + dN^(t)  (16) 

where  are  independent  Poisson  processes  defined  as  in  (6)  with  respect 
to  an  underlying  space-time  Poisson  process  M (see  (2))  whose  mark  space 
has  k points,  and  f^  are  continuous  processes  on  [0,T].  Let 

K(A)  =X)^(a)A^ 


4^3  (a  (t)  - a (;t2  "))A 
i 

-E  (;(■'-„  hMo-*  n,(4))a, 


where 


N^(A)  = N^(t)  - N^(£2  ")  . 
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Also,  define 


X (t)  ^ (H  (a))(t)  . 
n n 


(19) 


Then 


X^(t)  - X^{12  = (exp(K(A))  - l)X^{JL2  ") . 


(20) 


As  n -♦  ro,  the  length  a of  the  interval  [i2  ,t]  approaches  zero. 

The  following  heuristic  derivation  relies  on  two  facts; 

(Al)  Since  the  underlying  space^time  process  M is  uniformly  orderly 
[13],  n can  be  chosen  large  enough  so  that  there  is  at  most  one  jump  in 
[£2~'",t]; 

[A2]  For  n large  enough,  products  of  second  order  and  higher  in  a 
and  products  of  a and  N^(a)  are  negligible  as  compared  with  A and  N^(a). 


Assumption  (Al)  implies  that  all  the  N.(^)  but  one  (say  N.  (20)  are 


zero,  and 


N^(A)  = 1 , if  there  is  a jump  in  [j2  2 *^,t] 

= 0,  otherwise. 

Hence,  for  n large,  K(a)  can  be  approximated  by 

K(A)  = N (A)A  + . 

J J i ^ 

Notice  also  that  for  p = 2,3,... 

[Nj (A)]^  = 1 , if  there  is  a jump  in  [i 2 t] 


(21) 


(22) 


= 0,  otherwise 


so  [Nj(A)l^  = Nj(A).  Using  this  fact  and  (A2),  we  obtain 


(23) 


K(A) 


= [1+  (Nj(a)A^  + 5lA.f.(t)A)  + ^(N.(A)A.f  ^A.f,  (t)  A)^  + . . .]  - I 


=^^A^yt)A  + [I  f N.(a)(Aj  +-  ^ 


+ . . . ) - I]  . 


(24) 
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The  last  term  in  (24)  is  o - I it  N . (a)  = 1 and  0 if  N.(A)  = 0;  i.e.  , it  is 

Aj  } J 

equal  to  (o  - I)N^(A),  Since  the  jump  could  have  occurred  in  one  of  the 


other  processes  instead  (j  was  chosen  arbitrarily),  we  have 


A, 


(25) 


Substituting  this  result  into  (20)  leads  us  to  conjecture  the  following  theorem. 


Theorem  2;  The  sequence  converges  uniformly  on  [0,T]  almost 


surely  to  the  G-valued  stochastic  process  X which  satisfies  the  Poisson- 
driven  bilinear  equation 

A. 


dX(t)  = |";^A,f.(t)dt  + ^(e  ^ - I)dN.(t)|x(t) 
. i i 


X(0)  = I 


(26) 


Theorem  2 can  be  proved  by  making  the  preceding  derivation  rigorous , 
but  our  proof  is  much  more  direct. 


Proof:  If  N^(t)  = 0 , i = 1 , . . . ,k  , for  all  t e [0  ,T],  then  the  theorem 


reduces  to  the  deterministic  result  (9)  - (13).  Therefore,  suppose  that  there 
is  at  least  one  jump  in  [0,T],  and  choose  n sufficiently  large  so  that  there  is 


no  more  than  one  jump  in  any  interval  [i2  ^,(i+l)2  . This  can  be  done 


for  almost  any  sample  path  because  the  underlying  space-time  Poisson  process 


is  uniformly  orderly  and  the  total  number  of  jumps  in  [0,T],  EN  (T)  = N(T), 

i ^ 


is  finite  with  probability  one . Then 


J 


X„(t)  = n CMt) 
" j=0  " 


(27) 


where 


cjj(t)  = exp[B(0+l)2  ",j2"")] 


if  there  is  no  jump  in  a 


(28) 


C^(t)  = exp  [B(0+ 1)2  *^,Tj)]  exp  (A^  ) exp[B(T^,j2  ’’)], 


if  there  is  a jump  in  N at  time  '^,€A 

j ^ ^ 


(29) 
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Here,  B(t  ,t  ) is  defined  in  (13)  and  A,  = [j2  '^,0^  1)2  (in  the  equations 
At  J 

(27)-(29),  {l^\)2  is  tc  be  interpreted  as  t) . Since  the  total  number  of 

jumps  in  [0  ,T]  is  finite,  there  will  only  be  jumps  in  a finite  number  of  the 

intervals  A..  From  the  deterministic  results  (9)-(13),  it  follows  that  X 
j tt 

converges  uniformly  on  [0  ,T]  almost  surely,  and 


limX^(t)=  5(t,T^(^^)e 
n-»  00 


‘%(t) 


N(t)-1  Ai. 

j"  *<VrV=  ' 


^ (tj  , 0) 


(30) 


where  ^ ~ f solution  to  (9),  N(t)  = EN.(t),  and  there  is  a jump  in 
^ 1 i i 

Njj  at  tim.e  t.  (for  j = 1 , , , . ,N(t)) . It  can  easily  be  verified  that  (30)  is  the 
solution  of  the  equation 


^t  m)  A^. 

X(t)  = I f ][]A.  fJs)X(s)ds  + ^ (e  ^ - I)X(t.)  . 


(31) 


However,  (3)  implies  that  (31)  and  (26)  are  equivalent,  and  the  theorem 
follows . 


In  [17,18],  MeShane  defines  the  "canonical  extension"  in  order  to 
build  a consistent  theory  for  stochastic  differential  equations  driven  by 
almost  surely  continuous  noise  processes,  such  as  Brownian  motion  (but 
not  including  Poisson  processes).  For  example,  the  Ito  equation  (15)  is 
the  canonical  extension  of  the  deterministic  (or  Lipschitzian  noise)  equation 


X(t)  = 


j^[f,(t)  + u.(t)]Ajx(t); 

( i 1 


X(0)  = I 


(32) 


if  the  noises  are  Brownian  motion  processes . MeShane  also  shows  that  the 
canonical  extension  possesses  many  desirable  properties.  Accordingly,  we 
call  (26)  the  Poisson-driven  canonical  extension  of  (32)  and  show  that  it 
possesses  some  of  the  same  properties. 

Returning  to  the  rigid-body  orientation  example , if  A^  = -A| , then 
~ A ^i 

defining  B^  = e - I implies  that 


9 


rs»* 


B.  -i-  b;  + b:b. 

1 i 11 


A -A.  -A.  A. 

(e  - 1)  + (e  ^ - I)  + (e  ^ - I)  (e  ^ - I)  = 0 . 


Thus  the  Poisson-driven  canonical  extension  (26)  corresponding  to  (5)  does 
preserve  the  property  of  evolving  on  SO(3)  (see  Theorem  1),  This  fact  can 
be  generalized  as  follows  (the  proof  follows  easily  from  Theorem  1), 

Corollary  1:  Assume  that 

A|Q  + QA^  = 0 , i = 1,  . . . ,k  . (33) 

Then  the  solutions  X(t)  of  both  (26)  and  (32)  satisfy  X’(t)QX(t)  = Q, 

Thus  the  canonical  extension  preserves  the  property  of  evolution  on 
a Lie  group  (this  result  is  easily  extended  to  homogeneous  spaces) . 

As  noted  by  McShane  [17],  another  desirable  property  is  the  preser- 
vation of  the  adjoint  property.  That  is,  if  the  adjoint  of  (32)  is  defined  by 

Y(t)  = jEtyt)  + u.(t)](-A;)jY(t) 

Y(0)  = I (34) 

then  ^ X' (t)Y(t)  = 0,  and 
dt 

X'(t)Y(t)  = X'(0)Y(0)  = I , t s 0 . (35) 

That  the  canonical  extension  preserves  this  property  is  shown  in  the  next 
theorem . 


Theorem  3:  Consider  the  canonical  extension  (26)  of  (32),  and  define 
the  canonical  extension  of  (34): 

-A' 

dY(t)  = j£(-A|)f.(t)dt  + ^(e  ^ - I)dN^(t)jY(t)  . 

Y(0)  = I (36) 

Then,  with  probability  one,  the  solutions  of  (26)  and  (36)  satisfy 

X'(t)Y(t)  = X'(0)Y(0)  = I , t^O.  (37) 
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Proof: 
d(X' Y) 


By  the  differentiation  rule  (Lemma  1) , 

= x'^^(-A;)f.dty  + x'^;^A:f.dt^Y 

A.  -A' 

+ (e  ^ - I)X)'(Y-t-  (e  - I)Y)  - X’yjdN. 


A'  -a: 

= Z[x'e  e V - X’YjdN^  = 0 


Example  1:  This  example  is  analogous  to  one  presented  by  McShane 
[17,  p.  44],  and  it  illustrates  some  other  properties  of  the  Poisson-driven 
canonical  extension.  Assume  that  the  model,  for  scalar  Lipschitzian  dis- 
turbances a with  a(0)  = 0,  is 


X 


1 


X 


2 


da(s) 

Xj^(s)  da(s)  . 


(38) 

(39) 


Putting  this  in  the  form  (10)  where  x is  a 3-vector  (x2(t)  = 1),  the  model  becomes 


dx^(t)' 

0 0 1 

Xj^(t) 

dX2(t) 

= 

1 0 0 

X2(t) 

dX3(l)_ 

p 0 0_ 

X3(t). 

da(t)  — Ax(t)da(t) 


(40) 


x^(0)  = X2(0)  = 0 ; x^(0)  = 1 


McShane  shows  that  fa  (t)  Is  the  solution  for  X2  in  both  (40)  and,  if  a is  a 
Brownian  motion,  of  its  Ito  canonical  extension. 

Consider  now  the  Poisson-driven  canonical  extension  (26)  of  (40) 
(i.e.  , assume  that  a is  a Poisson  process): 


i 


f 


1 


11 


r 2 

i However,  by  the  differential  rule  (Lemma  1),  z(t)  = ^ (N  (t))  satisfies 


dz(t)  = ^[{N(t)  + 1)^  - F^(t)]dN(t) 

= (N(t)  + ■l)dN(t)  (42) 


which  is  the  same  as  the  equation  in  (41).  Hence  fa  (t)  also  solves  the 

Poisson-driven  canonical  extension  of  (40)  when  a is  a Poisson  process. 

As  noted  by  McShane,  this  solution  has  two  important  properties:  consistency, 
2 

since  fa  (t)  solves  both  (40)  and  its  canonical  extensions;  and  stability,  since 
two  noise  processes  that  are,  in  some  reasonable  sense,  "almost  che  same" 
will  result  in  solutions  for  which  are  "almost  the  same," 


i 

D 

1 


Thus,  this  work  can  be  viewed  as  an  extension  of  a portion  of  McShane's  i 

I results  to  Poisson-driven  bilinear  systems.  A more  detailed  treatment  of  the  .j 

% 

relationship  between  this  work  and  that  of  McShane  will  be  presented  in 
another  paper,  in  which  the  extension  of  the  Poisson-driven  canonical  exten- 
sion to  more  general  nonlinear  systems  will  be  presented. 


Ill,  MOMENT  EQUATIONS  AND  STOCHASTIC  STABILITY 

In  this  section  it  is  assumed,  for  simplicity,  that  the  n-vector  x 
satisfies  the  Poisson -driven  bilinear  system 

dx(t)  = Ax(t)  + Bx(t)  dN(t)  f gdM(t)  (43) 

where  g is  an  n-vector,  A and  B are  n x n matrices,  and  N and  M are  inde- 
pendent homogeneous  Poisson  processes  with  intensities  and  , respectively. 
In  order  to  investigate  the  moments  of  (43),  we  follow  Refs.  [3-5,10]  in  defining 
to  be  the  vector  of  p*’'’  order  moments  of  x,  and  A^^j  and  A^^^  to  be  the 
matrices  which  satisfy 


12 


(44) 


x(t)  = Ax(t)  ^ x’^P^(t)  = Aj.pjX^P^(t) 

a lid 

y = Ax  y’-P^  = a'-^^x*-^^  . (45) 

With  this  notation,  the  moment  equations  for  x(t)  are  derived  by 
applying  the  differentiation  rule  (Lemma  1)  to  (43); 

dx^*'^-'(t)  = A|.p^x*-^^(t)dt+  [(I-e  - I*-P^]x^^^(t)dN(t) 

+ [(x(t)  +-  g)^^^  - x^^^(t)]dM(t)  (46) 

whe-e  I denotes  the  n x n identity  matrix.  Furthermore,  from  the  properties 
of  the  counting  integral  [13,  p.  196],  it  follows  that 

ECx^P^t)]  = |a^p^  f x^[(I  + B)*-^^  - M}E[x^^^t)] 

+ E[(x(t)  + g)'-’^^]  - ECx^'^^t)]  . (47) 

It  can  easily  shown  that  the  term  E[(x(t)  + g)^^^]  - E[x^^^(t)]  is  a linear  com- 
bination of  E[x^^^(t)] , i=  l,.,.,p-l  (notice  that  E[x^^\t)]  does  not  appear  in 
this  expression  after  it  has  been  simplified).  Hence 


’x(t)  ^ 

11 

~ 

‘x(t| 

’ 

K A 
21  22 

0 

f-E 

• 

E 

dt 

• 

• 

• 

• 

• 

A , A , 

• 

'i!' 

. A 

x'rf(0 

L pi  p2 

PP_ 

where 
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(49) 


K.  = A. , + xMi+  . 

ii  [iJ  1 

This  representation  of  the  moment  equations  yields  the  following  theore 
which  is  the  direct  analog  of  the  Gaussian  white  noise  result  of  Brockett 
[5 , Theorem  4] , 

Theorem  4;  Let  the  process  x(t)  satisfy  (43),  and  assume  that 
E[c(x(0))]^  exists  for  all  linear  functionals  c and  for  p = 1,2,  ... . Then 

(i)  E[c(x(t))]^  exists  for  all  0 s t < ® and  all  linear  functionals  c; 

(ii)  there  exist  constants  M and  \ such  that 

P P 

E[c(x(t))l^  s M^e^p^d  + 1|E[x(0)]1|P)  . (50) 

The  representation  (48)  also  shows  that  the  stability  of  the  moments  of 
(43)  depends  only  on  the  eigenvalues  of  the  however,  no  simple  necessary 
and  sufficient  conditions  for  stability  in  terms  of  A and  B are  available.  A 
sufficient  condition  appears  in  the  following  theorem. 

Theorem  5:  Let  the  process  x(t)  satisfy  (43) , and  assume  that  there 
exists  a symmetric  positive  definite  Q such  that 

B'QB  + B'Q  +-  QB  = 0 ; A'O  + QA  < 0 . (51) 

Then  the  moment  equations  are  asymptotically  stable — i.e.  , all  moments 
x^^^(t)  of  (43)  which  exist  initially  approach  a constant  value  as  t approaches 
infinity,  and  this  value  is  independent  of  the  initial  distribution. 

Proof:  First  notice  that  the  stability  of  (48)  is  not  altered  if  we  set 
g = 0 ; so  we  assume  this  condition  holds.  Also,  the  stability  of  the  moments 
of 

y(t)  = Q^x(t)  (52) 

and  x(t)  are  the  same.  If  x satisfies  (43)  and  (51),  then  it  is  straightforward 
to  show  that  y satisfies  (43)  and  (51)  with  Q = I.  Then  Lemma  1 and  (46) 
imply 
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+ jy*-^^  ^ (I  i-  + (I  + y*-P^ 

- y*-^^'y'-^^)dN(t) 

" ‘’“''''ipi " ^pl’ 

+ {y*’^^  (I  + B’  + B + B'B)^"^^  y^^^  - y*-P^'  y*-P^jdN(t) 

" ^^ip]  ^ ^p]^  (53) 

Hence , 

^E[y'^^'(t)y'^P^(t)]  = Ety’^^  V)(Afp;i  + Aj-pj)  y'^P^(t)]  s 0 (54) 

and  the  right-hand  side  of  (54)  equals  zero  if  and  only  if  y^^^(t)  = 0 almost 
surely,  which  is  true  if  and  only  if  E[y*''^^  (t)y*'^^{t)]  = 0 . A Lyapunov-type 
stability  argument  implies  that  E[y^^^  (t)y^^^(t)]  -♦  0 as  t -♦  ® ; hence  the  same 
is  true  for  E[y^^^(t)],  and  the  theorem  is  proved. 
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